Topological antiferromagnetic phase in a correlated Bernevig-Hughes-Zhang model 
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Topological properties of antiferromagnetic phases are studied for a correlated topological band 
insulator by applying the dynamical mean field theory to an extended Bernevig-Hughes-Zhang 
model including the Hubbard interaction. The calculation of the magnetic moment and the spin 
Chern number confirms the existence of a non-trivial antiferromagnetic (AF) phase beyond the 
Hartree-Fock theory. In particular, we uncover the intriguing fact that the topologically non-trivial 
AF phase is essentially stabilized by correlation effects but not by the Hartree shifts alone. This 
counterintuitive effect is demonstrated, through a comparison with the Hartree-Fock results, and 
should apply for generic topological insulators with strong correlations. 
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I. INTRODUCTION 

In the last three decades, a new class of quantum 
phases which are described by topological field theory 
has attracted much interest. The topological structure 
is reflected in the existence of gapless edge states and 
in characteristic magnetoelectric responses. The first 
example was an integer quantum Hall phase, which is 
characterized by the Thouless-Kohmoto-Nightingalc-dc 
Nijs (TKNN) number and shows the quantized Hall con- 
ductivity in an applied magnetic ficldji Furthermore, in 
this decade, I2 topological band insulators (TBIs) have 
been found as a new family of topological phasesi^"— For 
the realization of a Z2 topological phase, the spin-orbit 
(SO) coupling plays the essential role instead of the mag- 
netic field. TBIs have been extensively studied from both 
experimental and theoretical viewpoints, and their real- 
ization in two- and three-dimensional systems has been 
found in HgTe/CdTe quantum wellsi^ and bismuth based 
compounds!^"— 

Recently, correlation effects on the TBIs have spurred 
intense activities in theory, since electron correlations 
are expected to create exotic states under topologi- 
cally non-trivial conditions. This issue has further been 
stimulated by theoretical proposals for the realization 
of topological phases in d-, /- electron systems, (e.g. 
iridium oxides,— Heusler compounds,—!^ and filled 
skutterudites^i) . In the context of correlation effects 
on TBIs, the competition between long-range ordered 
phases and TBIs have been addressed)^"— For exam- 
ple, a competition between an antiferromagnetic (AF) 
phase and the TBI phase was studied by numerical ap- 
proaches as well as mean field theory. In a quantum 
Monte Carlo study by Hohenadler et al.^ it was clari- 
fied that the TBI phase can change into a topologically 
trivial AF phase. This statement was supported by the 
results obtained with a variational cluster approach and 
also by the results obtained in a cluster dynamical mean 
field studyi^i^ The former study also clarified the ab- 
sence of edge states in the AF phase 1^ 

In parallel with these efforts, antiferromagnetic topo- 
logical insulators (AFTIs), i.e. AF insulators having 



non-trivial topological structures, have been studiedi^"— 
Such a phase was first proposed by Mong et al.^ 
who found that if a three-dimensional insulator breaks 
both time-reversal (0) and primitive-lattice translational 
(2^1/2) symmetries but preserves the combination S = 
QTi/2 (S serves as the time- reversal operator at a cer- 
tain plane of the Brillouin zone), then the system may 
have a topological structure. According to the periodic 
table of TBIsr^"— AFTIs may not be realized in generic 
two-dimensional systems, but we can still find such AFTI 
phases under spin quantized conditions 1^ 

Because the above studies have been restricted to 
Hartree-Fock mean-field theory, there are still open and 
interesting questions about AFTIs. This paper aims to 
study the AFTIs by incorporating electron correlations 
beyond the Hartree-Fock treatment. To this end, we ana- 
lyze an extended Bernevig-Hughes-Zhang (BHZ) modeli 
including the Hubbard interaction with the dynamical 
mean field theory (DMFT) and the numerical rcnormal- 
ization group (NRG). We elucidate the remarkable fact 
that an AF phase can have a topologically non-trivial 
structure near the transition point even if the Hartree- 
Fock treatment does not support it. We demonstrate 
that the renormalization of the electronic states due 
to strong correlations is essential to stabilize the AFTI 
phase. This kind of renormalization is inherent and ubiq- 
uitous in correlated TBIs, and may play the key role in 
realizing non-trivial ordered phases. 

This paper is organized as follows. First, the model 
and the method are briefly explained in the next section. 
In Sec. mil we present the results obtained with the 
DMFT, and discuss how the AFTI is stabilized in the 
presence of strong correlation effects. A brief summary 
is given in the last section. 



II. MODEL AND METHOD 

We extend the BHZ model, which is deflned on a two- 
dimensional square lattice, to include an on-site Coulomb 
interactioui^i^ The Hamiltonian reads 
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where rn^a^a = cl.a,a<^i,a,a- The operator cl^,^{ci^a,a) 
creates (annihilates) an electron at site i and in orbital 
a = 1,2 and spin a =t, 4- state. The off-diagonal ele- 
ments of the hopping matrix t drive the system into a 
non-trivial band insulator at U = 0. We analyze the sys- 
tem using DMFT, which treats local correlations exactly 
and is suitable for the systematic calculation of arbitrary 
strength of the Coulomb interaction. In DMFT, the orig- 
inal lattice problem is mapped onto an effective impurity 
model, which is solved self-consistently4ir— The self- 
consistency equation for a paramagnetic phase is given 

by 
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where h^^k) is the Fourier transform of the hopping 
matrix. The self-energy of the lattice Green's function 
So.(aj) can be computed from the Green's function g{uj) 
of the effective impurity model. Note that, since the 
orbitals are hybridized by SO coupling, the hybridiza- 
tion function is diagonal in the orbital index. Thus, off- 
diagonal elements of the self-energy (Scr)a,a are supposed 
to vanish in our model. In this study, we employ the NRG 
method to solve the impurity model ;^^'^^ which is a pow- 
erful method for calculations at zero-temperature. To 
analyze the AF phase, we use the sublatticc method?^ 
where the original square lattice is divided into two sub- 
lattices specified by checkerboard pattern. 

For simplicity, we study the particle-hole symmetric 
case and choose the model parameters as = ^2 = t, 
t' = Q.lt and £1(22) = The hopping integral t is 

chosen as the energy unit. 



III. NUMERICAL RESULTS 

First, let us briefly discuss the Hartrcc-Fock results. In 
Fig. [U the results arc shown as a function of the inter- 
action strength U . A close examination of the effective 
Hamiltonian in the strong coupling region elucidates that 
the off-diagonal elements of the hopping matrix in- 
duce a spin dependent exchange; the z-component of the 
exchange interaction is antifcrromagnetic, while the in- 
plane components are ferromagnetic (antifcrromagnetic) 
between neighbors in y- (a;-) direction, respectively. This 



results from the fact that the phase of the intra-orbital 
hopping affects the spin-exchange process. Thus, the spin 
configuration of the AF phase is expected to be the one 
shown in Fig. [Ua). In this figure, the staggered moment 
is parallel to the z-axis, and the in-plane components are 
zero. Here it should be noted that this effective Hamil- 
tonian preserves four-fold symmetry; the Hamiltonian is 
invariant under the 7r/2 spatial rotation combined with 



the rotation of the spin space (S'j j' 



5^^^^') at every 



site, where represents the x (y) component of spin 

operator at site i and orbital 1, respectively. 

In Fig. [IKc), we show that for U < 3.3 {U > 3.8), the 
system is in a paramagnetic phase (AF phase) respec- 
tively. Accordingly, the Brillouin zone is reduced (Fig. 
[T](b)), since the ordering vector is (7r,7r). In this figure, 
for 3.5 < ?7 < 3.78, a hysteresis behavior is observed^, 
and in the region of 3.3 < U < 3.5, the paramagnetic 
( AF) solution is stable (unstable) . Corresponding to the 
magnetic transition, in Fig. [T] (d), we observe that the 
topological property changes at U — 3.8 (U = 3.5) with 
increasing (decreasing) interaction. As a result, a non- 
trivial AF phase is not found. This is attributed to the 
large Hartree shift induced in the AF phase. Recall that 
in our model, the origin of the gap depends on the energy 
splitting (£2 ~ e'i)j where e'a.a is the energy level of each 
orbital including the Hartree shift, and if it becomes zero, 
the gap closing occurs. In the region of e[ — €2 < 0, the 
gap is induced by the SO interaction. Moreover, in this 
region, we can confirm that the system possesses non- 
trivial topology (see Fig. 1 (d)). If the Green's function 
has no anomaly (gap closing or zeros of it), the topolog- 
ical properties are never changed.—— We thus conclude 
that for e[ < e'2 the system is driven into the non-trivial 
phase. Keeping this in mind, we plot the energy levels 
in Fig. [IJc). In this figure, a region satisfying the non- 
trivial condition is not found within the AF phase. We 
have also checked other choices of parameters, but could 
only find a topological-trivial AF phase in the physically 
sensible parameter regions. 

Let us now discuss the results obtained with DMFT, 
and clarify what happens when electron correlations are 
taken into account. In Fig. Ufa), the AF moment is plot- 
ted as a function of interaction strength. We can clearly 
observe a jump atU = 4.5 {U = 4.2) with increasing (de- 
creasing) interaction strength, respectively. In order to 
clarify the topological properties, we calculate the spin 
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FIG. 1: The results obtained with the Hartree-Fock approx- 
imation: (a) spin configuration of the AF phase, (b) sketcli 
of the reduced Brillouin zone, (c) magnetic moment at or- 
bital 1, (d) spin-Hall conductivity, (e) energy level of each 
orbital modified by the Hartree shift. For 3.5 < U < 3.78, 
the coexistence region inherent in the first-order transition, 
can be found. The energy of each phase crosses at f/ ~ 3.6, 
which determines the phase transition point for the thermo- 
dynamically stable phase diagram. Note that in this figure, 
no non-trivial AF phase is found. 



Chcrn number (SChN)4i'^"— We note again that the 
AFTI phase can be stabihzed in our model, since the 
Green's function for the magnetic phase is diagonal in 
spin space, and therefore its topological properties are 
specified by the SChN even in this phase.— 
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Here, the notation p = {iuj,p) is used. Note that even 
in the interacting case, this quantity is proportional to 
the spin-Hall conductivity^-^ In Fig. [^b), the SChN 
is plotted as a function of interaction strength. Note that 
the system has a bulk gap for each phase, as discussed 
momentarily below. In this figure, we find that the sys- 
tem is in the TBI phase at C/ = and retains its topo- 
logical properties up to C/ = 4.6. Moreover, as seen in 
Fig. [2] (a), for 4.5 < U, only the AF solution is obtained. 
Wc therefore end up with an AFTI phase, which is not 
observed in the Hartrce-Fock treatment. Furthermore, in 
the coexistence region, the AFTI phase is also stabilized 
for 4.3 ^ U < 4.5. We thus come to the remarkable con- 
clusion that strong correlations (quantum fluctuations) 
drive the system to the AFTI phase. Here, it should be 
noted that, in the AFTI phase, we can observe both the 
quantized spin-Hall conductivity and the AF order. 
To understand how the electronic states are changed 
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FIG. 2: (Color Onhne) (a) The AF moment of orbital 1 as 
a function of interaction strength, (b) The SChN as a func- 
tion of interaction strength. Inset: the SChN (red) and the 
magnetic moment of orbital 1 (blue) are plotted. In figure 
(a), the coexistence region is also observed in the DMFT re- 
sults for 4.2 < U < 4.5. Here the first-order phase transition 
point, where the energy of each phase crosses, is estimated as 
U - 4.3. 



at the transition points, we now discuss spectral proper- 
ties. The local density of states, defined as A^.^i^) = 
— ■^ImGa^a.ai'^ + for an up-spin dominant sublat- 
tice is shown in Fig. [3] for several values of interac- 
tion strength. In the insets, the total spectral function 
{A{uj) = ^ Aa^cr{uj)) near the Fermi energy is plotted. 
We observe a bulk gap in both phases. In the param- 
agnetic phase, the spectral functions of each spin state 
are identical. In the AFTI phase {U = 4.4), the spec- 
tral functions for (a, cr) = (l, J.) and (2, t) have peaks near 
the Fermi energy, while those for (a, (t)=(1, t) and (2,4-) 
have a hump structure around lu ^ zLU/2. With fur- 
ther increasing the interaction strength, the topological 
structure of this system becomes trivial. In this triv- 
ial AF phase, we can see that the electronic structure 
near the Fermi energy is changed; the peak just below 
(above) the Fermi energy is mainly composed of the state 
{a, a) = (2,t) ( (1,1) ) respectively. 

For further insights into the AFTI phase, the 
momentum-resolved spectral functions are plotted in Fig. 
m In these figures, it is shown that states near the Fermi 
energy can be well labeled by the momentum (correlated 
band insulator). As seen in Fig 4(a) and (b), in the region 
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FIG. 3: (Color Online) Spectral functions for an up-spin dom- 
inant sublattice {Aa,cr{u})) for several values of interaction 
strength. At (7 = 3, (4.4, 4.8), the system is in the TBI, (non- 
trivial AF, trivial AF) phase respectively. Solid red (solid 
blue, dashed red, dashed blue) line represents that of the 
state {a, a) = (l,t) ((1, |), (2, t), (2, |)) respectively. Inset 
(left): the total spectral functions (Ea.crAco-) near the Fermi 
energy (w = 0). Inset (right): the spectral function near the 
Fermi energy around a; = 0. 



between {kx,ky) ==(37r/4,0) and {tt/2,tt/2), each orbital 
contributes to the coherence peaks, which is consistent 
with the behavior of the LDOS (see Fig. 3). Thus, we 
can conclude that the gap is generated by the SO interac- 
tion in this region, while as seen in Fig. |3Jc) and (d), in 
the trivial AF phase, the peaks below the Fermi energy 
are mainly contributed by the state {a, a) = (2,t), and 
thus, the gap is induced by the AF order. This confirms 
that the topological AF phase is induced by the electron 
correlation. 

Since the system behaves as a correlated band insula- 
tor in the non-trivial AF region, as mentioned above, 
we expand the self-energies around a; = and plot 
the renormalized energy level of each orbital defined by 

^a.a = Za,ai£a,<T + ^a.ai^^ = 0)), whcrC the Za.^- is the 

rcnormalization factor of each orbital in Fig. [SJ Note that 
as long as the system is recognized as a correlated band 




(0,0) (7t/2,0) (31,0) (7t/2,7t/2) (0,0) 



(b) 

0.2 




U=4.4 (2,T) 



-0.2 



(0,0) (71/2,0) 



(71,0) (7t/2,7t/2) (0,0) 



U=4.8 (l,i) 




(0,0) (71/2,0) (71,0) (71/2,71/2) (0,0) 



(d) 

0.2 




^=4.8 (2,T) 



-0.2 



(0,0) (71/2,0) 



(71,0) (71/2,71/2) (0,0) 



50 
40 
30 
20 
10 




50 
40 
30 
20 
10 




50 
40 
30 
20 
10 




50 
40 
30 
20 
10 




FIG. 4: Momentum resolved spectral functions {Aa CT(k, cj)) 
for (a, a) = (l,;),(2,t): (a),(b) for U = 4.4, (c),(d) for U = 
4.8. 




FIG. 5: The renormalized energy level of each orbital {e^^a 
as a function of interaction. 



insulator, the relation .|- > £* ^ is the condition required 
for existence of the SO induced gap. In this figure, we 
can see that for 4.2 < U < 4.6, the state (a, a) = (1,1) is 
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located below the Fermi energy, implying that the energy 
gap is dominated by the SO interaction. Since such an 
SO induced energy gap in the AF phase is not observed 
at the Hartree-Fock level, we conclude that correlation 
effects renormalize each band and thus suppress the en- 
ergy shifts resulting from the spin polarization. This kind 
of renormalization should commonly occur in TBIs. 

Finally, we comment on the edge states. The nonzero 
spin Hall conductivity in the AFTI phase implies the 
existence of gapless spin excitations on open edges, which 
carries the spin Hall current, when the system has open 
boundaries^. Thus one can deduce that the AF order 
is suppressed at the edges, and the helical edge states 
are topologically protected against magnetic instability, 
in spite of the existence of the bulk AF order. 

IV. SUMMARY 

In summary, we have studied topological properties of 
the AF phases in the extended BHZ model including lo- 
cal Coulomb interaction. The DMFT+NRG calculation 
of the magnetic moment and the spin Chcrn number has 



suggested the existence of a topologically non-trivial an- 
tiferromagnetic phase, where one can observe both the 
quantized spin Hall conductivity and the magnetic or- 
der, even if the Hatree-Fock treatment does not support 
it. We have demonstrated that the correlation effects are 
essential to realize the non-trivial AF magnetic phase; the 
correlation effects strongly renormalize the energy-level 
shift induced by the AF ordering, keeping the system 
still in the band-inversion regime. Although the detailed 
situations should depend on the system under consider- 
ation, this kind of renormalization effect is inherent in 
the TBI caused by the band-inversion mechanism, which 
encourages us to look for topologically non-trivial phases 
in the strong correlation regime. 
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